Stochastic chemical kinetics with energy 
parameters 

Guy Fayolle, Vadim Malyshev, Serguei Pirogov 



ABSTRACT: We introduce new models of energy redistribution in stochas- 
tic chemical kinetics with several molecule types and energy parameters. The main 
results concern the situations when there are product form measures. Using a prob- 
abilistic interpretation of the related Boltzmann equation, we find some invariant 
measures explicitly and we prove convergence to them. 

1 Introduction 

Metabolic pathways in molecular biology are chains or networks of chemical reac- 
tions providing redistribution of energy, in particular synthesis of ATP molecules, 
universal energy stocks in cells. Here we elaborate simple models of energy redis- 
tribution. According to a classical approximation, the energy of a molecule can be 
subdivided in two parts: internal (chemical) energy and kinetic energy. The model 
is the following. 

Assume that there are V molecule types v G {1, . . . , V}, n v (t) molecules for each 
type v at time t. Types v can be interpreted as chemical substances with different 
formulas, different isomers of the same formula, or even as different energy levels 
(spectrum) of the same molecule. 

The total number of molecules M = Y^, v n v (t) will be conserved. A molecule may 
be characterized by a pair (v, T), v = 1, . . . , V, where T € R+ is the kinetic energy 
of the molecule. Then each molecule of type v at time t has energy 

E(t)=I(v)+T(t), 

where I(v) is the internal (or chemical) energy of any molecule of type v, T(t) 
being the kinetic energy of a concrete molecule at time t. Thus, for any v, t, I(v) 
are fixed numbers and T(t) are random. 

We use the approach usually refered to as stochastic chemical kinetics. It appeared 
in physical papers, see [5 , but was also explored also by mathematicians for many 
models with small V, (see e.g. the reviews (US])- However these models did not 
consider any energy parameter. Independently of this, Kac [3J considered a beau- 
tiful model with mean field collisions. Deeper results in this model appear even 
recently, see [T]. However, in Kac's model molecules were characterized only by 
kinetic energies, that is V = 1. Our model can be considered as a mixture of these 
two: there are molecule types and energy parameter. 

The plan of the paper is as follows. In section 2, we introduce our probabilistic 
microscopic model and provide the corresponding Boltzmann type equation. Proof 
of the finite microtime scaling limit convergence to this equation uses standard 
technical tools and will be published elsewhere. In section 3 we get deeper results 
for the one type case with uniform scattering: find invariant measures and prove 
convergence of the Boltzmann equation for large macrotime. In section 4 we provide 
many examples, with similar results for multitype models. 
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2 Finite time scaling limit 

Unless otherwise stated, we consider a system of binary reactions of the form 
A+B — > C+D. We assume energy conservation and random momentary collisions, 
that is when a pair of different molecules (v,T), (v',T') collide at time t then a 
new pair (yi, U), (v[, U') appears at time t + 0, so that 

I(v) +T + I{v') +T' = I(vi) + U + I(v[) + U'. 

Obviously, the reaction is possible only if 

I(v) +T + I(v') +T'> J(«x) + I(v[). (2.1) 

We define the following continuous time Markov chain. The state is an array of V 
vectors ((v,Ti),i — l,...,n v ),v £ V. Thus, their total length M = J2v=i n v 
is conserved, but not necessarily n v . The order of components in each vector 
((y, Tj), i — 1, . . . , n v ) does not play any role, so that we will consider only func- 
tions symmetric in the vector coordinates. 

On the time interval (t,t + dt), each pair of molecules (v,T), (y',T') has a colli- 
sion with probability 4ja vv /(T,T')dt, The functions a vv >(x, y) are assumed to be 
bounded and smooth on . As a result of this collision, some pair (v-y , U) , (v[ , U') 
appears, provided that condition (|2.1[) holds for at least one pair (vi,-^). Other- 
wise nothing occurs. The distribution of the new pair is defined by the rules listed 
hereafter. For any vi,v[,v, v',T, T', the conditional densities 

P(K,[/)X|( W ,T),(?/,T')) >0 
are supposed to satisfy the following properties. 

1. If 

I(v) +T + I(v') + T' < I( Vl ) + I(v[), 

then 

P((w 1 ,(7), U ;|(i;,r),( U ',T')) =0. 

2. For any v, v' , vi,v[, T, T', the density function 

f(U) = P((v u U),vi\(y,T),(v'X)) 
is defined on the interval I=[0,I v +T + I v - + T' - I(vi) - I(v[)] and 

J P((v u U),v' 1 \(v,T) ) (v' ) T'))dU=l. 

Thus the distribution of the triple (yi,U,Vi) is entirely defined by 

P(K,L/),^|KT),K,T')) 
and U' = I(v) +T + I(v') + T - + U + I{v[)). 

Hence, for V finite sets {T v i, . . . , T v>riv } , v = 1, . . . , V, we have defined a Markov 
process on R¥ , which will be denoted by Cm- It is worth remarking that, when 
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the total energy U is fixed, Cm has a compact state space. Then, under some 
nondegeneracy conditions on a and P, this Markov chain for fixed M approaches, 
as t — > oo, its unique stationary distribution -k^ m \U). Our goal will be to study, 
under some conditions, the scaling limit M — > oo for fixed i, and also the large 
time limit t — > oo. 

Let n v M ^ (A, t) denote the number of type v molecules at time t having kinetic 
energy T in the set A C In the limit M — > oo we have to impose initial 
conditions at time zero 



for some nonnegative functions p v (x, 0), Y^ v j R+ p v (x, 0)dx — 1, called concentra- 
tions. Our goal is to prove that, as M — > oo, the sequence of Markov processes 
Cm converges to some deterministic evolution C of the concentrations. We state 
now our first result. 

Theorem 2.1 For any A and t, there exist deterministic limits (in probability) 



where the p v (x 7 1) 's are some non-negative functions satisfying the following Boltz- 
mann type equations 



with the initial condition p v (x,0). 

Other reaction types Quite similarly one can consider other types of reac- 
tions. For example consider the reaction A — > B + C. In this case on the time 
interval (t,t + dt) each molecule (v,T) with probability a v (T)dt is transformed 
into two molecules (note that the scaling is different here) . The distribution of the 
products (vi, U), (v' l7 U') is defined by similar kernels P((v\,U),v[\(v,T)) under 
the condition 



3 One type case 

3.1 Probabilistic interpretation 

We consider in this section the particular situation with only one molecule type 
v. It will be also assumed that the rates a(T, T") = a vv (T, T") = a and the condi- 
tional probabilities P(U\T, T') are uniform on the interval [0, T + T'\. It turns out 






{x, z)P((v, y),v'\ (t>i , x), (v[ , z))p m (x, t)p v>i (z, t)] dydz 



(2.2) 



I V1 + Iv[ <Iv+T. 
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that the limiting stationary distribution can be found explicitly. Indeed, equation 
(12.21) can be rewritten as 



dp{x,t) _ _ f°° ds 
dt 



p(u,t)p(s — u,t)du — ap{x,t). (3-1) 
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[Similar equations appeared in [2 in a different context]. Now one can guess a 
fixed point: it is p(x) = f3e~^ x , but it also can be obtained from a very clear 
probabilistic picture. 

Let us consider finite particle dynamics, that is the chain C m , the states of which 
are finite subsets of R + with M elements. 

Take first the case M = 2. Define the chains £2 (£7) as the restriction of C2 on 
states with total energy U. Then the chains C^iU) are irreducible and nilpotcnt: 
that is, already after the first jump we get the stationary distribution ^(U), with 
T uniformly distributed on [0, U] and T" = U — T. Hence, for any initial condition, 
£2 is a mixture of C%(U). We see that, for any density f(U), the measure 

7T 2 (U)f(U)dU 

R+ 

is an invariant measure for £ 2 ■ Indeed one of these invariant measures is of greatest 
interest to us. Let the random vector (£1,62) on R\ be defined by the measure 
P2,/3, such that the two random variables £1, £2 on R + be i.i.d with density p(x) — 
(3exp(—(3x). Consider a new random vector (771,772)) where 771 is picked at random 
on the interval [0, £1 + £2] and 772 = £1 + £2 — 771. This defines a transformation of 
measures p' 2 p = Wp2,p- In fact we have the following 

Lemma 3.1 The measure p2.fi is invariant with respect to W, that is 

/4,/3=M2,/9- (3.2) 

Proof. Immediate, since the density of £ = £1 +£2 is (3 2 x exp(— fix). Then picking 
a random point on the interval [0, x] yields fX2,/3, whence equality (|3.2I) follows. ■ 
In addition, Q3.2p gives 



r°° dx f x 
p(u) = — p{y)p{x - y)dy, 

Ju x JO 



which is exactly the stationary form of equation (|3.ip . 

For M > 3, the Markov chain Cm has also irreducible components £m(U), con- 
sisting of all states (Ti, . . .,T M ) with T\ H V T M = U. For fixed M and U 

the invariant measure of the chain Cm(U) is the uniform measure on the simplex 
Ti + ■ ■ ■ + Tm = U. An invariant measure on Cm can be found as follows. 
Take M independent particles, having each density (3e~P x on R + and let pm,p 
denote their joint distribution. 

Lemma 3.2 The measure p,M,p is invariant for Cm- 

Proof. It follows from the previous lemma, because the generator of Cm is the 
sum of generators corresponding to all pairs (i,j),i,j = 1, . . . , M, i ^ j. ■ 

Remark 3.1 One can show that Cm{U) is reversible, by using the classical Kol- 
mogorov 's reversibility criteria for Markov with transition rates X a p , namely 

See related questions in JBj]. 
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3.2 Convergence for Boltzmann equation 

According to the above section, when the total initial energy U satisfies the con- 
dition U = M/(3, we have 

l im l im ^ M W) = f p e -Px dx _ 



M->00 t—HX M 

We will consider now the quantity lim t _ i . 0O limA/_ ! . 0O . 

Theorem 3.3 For Boltzmann equation I2.2jl . for any initial condition p(x,0), we 
have 

lim p{x,t) = f3e^ x , x>0 (3.3) 

t— loo 

Proof. The sketch is the following. First, we prove in the next subsection, under 
more general assumptions, that any initial distribution converges to some fixed 
point. Secondly, we will show that there is a unique one-dimensional manifold of 
fixed points, namely f3e~^ x , < f3 < oo. This will conclude the proof, since j3 itself 
is uniquely determined by the initial mean energy 



M 

T(0)= lim £^(0) = -. 

M-s-oo M z — ' n 



3.3 Local equilibrium condition 

We come back here to an arbitrary number of types. We will say that a posi- 
tive function f{v,x) on V x R + with J f(v,x)dx — C < oo, satisfies a local 
equilibrium condition (LE) if, for any 7,71, 

^h(7,7i|7',7i)/(7')/(7i)-^(7',7il7,7i)/(7)/(7i)] = 0, (3.4) 

7', i[ 

where we use the notation 

7= (w,ar), ^2 = ^2 dx > 

7 v J 

and 



w(7»7i|y»7i) = 

a v i v ' i (x',x' 1 )P((v,x),v 1 \(v',x'), (v[, x' l ))8{x 1 - (x' + x' 1 +I V > +/„/ -x-I v -I vl )). 

One can assume C = 1. Then, in the one type case, this is tantamount to saying 
that £2 has the invariant product form distribution f{x)f{y). 

The fixed point condition (FP) 

E ^7, 7i IV, 7r)/(7')/(7i) - 7r |7, 7i)/(7)/(7i)] = 0, (3.5) 

7ii7'.7i 
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valid for any 7, follows immediately from (13.41) . 

We shall say that f("f) satisfies a detailed balance condition (DB) whenever 

w(7, 7i IV, 70/(7')/(7i) " u>(V, 7il7, 7i)/(7)/(7i) = 0, (3.6) 

for any 7, 7', 71,71. In the above one type example, DB condition holds if one 
chooses 

fo = Pe-e*, 

for any positive /3. Note that DB— >LE— >FP. 

Let us define the relative entropy of / with respect to fo, assuming both / and /o 
are positive. Farther on, fo will be fixed and therefore omitted in the notation, so 
that 

//;/! //(/../;,; ^ f<-:]> J' 

7 



/(7) 



(3.7) 



Theorem 3.4 Assume that there exists some /o(7) > satisfying the local equi- 
librium condition. Then for any initial f(j,0) with i7(/(.,0)) finite, the function 
fil) = f{l->~t)> that is the solution of equation does satisfy 

dt ~ 

Moreover, as t 00, f("f,t) tends to some fixed point foo which depends in general 
on the initial data /(7,0). LE condition holds for any stationary solution f, that 
is for any fixed point of \2.2\l . 



Proof. The integrability of follows from (12.21) . so that the following conser- 
vation law holds 

df(l) 
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Differentiating p. 71) and using p.8[) , we get 

7o(7) 



dH(f) ^ df( 7 ) 



dt ^ dt 



We rewrite condition (13.41) as 



/(7) 



El I / /n/o(7 )/o(7l) ,/ / n s 

™(7,7i 7 ,7i) -TTTfTT = 1^ w ^ '7i 7,7i), 
, , /o (7)/q(7i) , 

and set for the sake of shortness f = J2-y 7l y y ■ Then, for any function 7(7), we 
have 

"(7, 7i IV, 7i) TTTTT^T /fr) /(7i) = / M7',7i|7,7i)/(7)/(7i), 
7o(7)/o(7i) 7 

or, after a change of variables, 

| ^7',7ll7,7i)/(7)/(7i) = / 7il7, 7i) f^|^ /(tW)- 
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Let 0( 7 ) = log . 



Then 



7 

0(7)['^(7.7i|7' J 7i)/(7')/(7i) ~ «>(7'j7il7>7i)/(7)/(7i)] 
[0( 7 )-0( 7 ')]^(7,7il7',7i)/(7')/(7i) 
= o / [^(t) + < ^ ) ^ 1 ) ~ ^(t') ~ ^(7i)]™(7,7i|7',7i)/(7')/(7i)- 



2 

Set for a while 



, _ /o(7)/o(7i)/(7 , )/(7() 
/(7)/(7i)/o(7')/o(7i)' 

_ MY)fo(l'i) 
/o(7)/o(7i) ' 
so that 

log£ = 0(7) + 0(7i ) - 0(7') - <M7i)- 

Then 

dt =2 / «ClogCw(7,7i|7',7i)/(7)/(7i)- 
On the other hand, from the LE condition, 

a£™(7,7i|7',7i)/(7)/(7i) = / aM7,7i|7',7i)/(7)/(7i) 



which yields 



(£ log? - £ + 1 W7, 7i IV, 7i)/(7)/(7i) > 0, 



2 

since £ log£ — £ + 1 > if £ > 0, due to the convexity of £ log£. 

Assume now that for some /o > the local equilibrium condition holds. Then 
it holds also for any other stationary solution /, i.e. satisfying -£ = 0. In fact, 

note that ^ > if /( 7 )/(7i) > 0,tu(7,7i|V>7i) > and £ ^ 1. Also, if / 
is a stationary solution of equation (|2.2[) then ^ffi = and hence dH J/^ = 0. It 
follows that, for any 7,7i,7',7i such that /(7)/(7i) > and u>(7,7i|t / ,7i) > 0, 
we have £ = 1, that is 

f(j)f{l[) /o(7 , )/o(7() _ 
f (1)1(11) /o(7)/o(7i) ' 

On the other hand, if = 0,/(7) = and w(7,7i|7',7i) = 0, then we get 

/(tO/CtQ — as a consequence of equation (I2.2|) . Thus, for any 7,71, equation 
(|3.4[) holds. Any solution f(t) of equation (|2 .2[) as t — >• 00 tends to some stationary 
solution /oo, which depends in general on the initial data /(0). In fact, from the 
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proof of theorem 12. 1[ it follows that / is a stationary solution, i.e. nf = 0, if 

and only if dH J/' — (provided that (|2.2j) holds). This means that H(f) is a 
Lyapounov function. Consequently, the expected result follows from the general 
theory of Lyapounov functions and the proof of the theorem is terminated. ■ 



3.4 Fixed points and conservation laws 

fo 



Now we will prove that, for any two fixed points fo, f, the function log 4- is an 



additive conservation law. Consider the equation 

/(7)/(7i) /o(t)/o(7i) ' 
/(tWi) 



(3.9) 



For /o = 1, we have 



/(7)/(7i) 



1, (3.10) 



which shows that log / is an additive conservation law. Vice versa, if there is a set 
J of additive conservation laws such that 

then, for any constants c, Cj , 

/(7) =cjjexp(c i 7/ i (7)) 

is a solution of (|3.10j) . Note that additive conservation laws form a linear space. 
Thus we have proved that any solution of (|3.10[) has this form. In the general case 
(that is if fo ^ 1), we have 

— =cJJexp(c J -77 J (7)). 

It is worth noticing that a nonzero additive conservation law for the chain Cm is 
in fact unique, if the chains Cm(U) are irreducible, for all U. 



4 Invariant measures for multitype models 

Here we will analyze some cases with V > 1, when there exists an invariant measure 
having a product form. 

4.1 Binary reactions without type change 

Let for any v = 1, . . . , V a density p v (x) > on R + be given. Assume only reactions 
v,w — > v,w are possible, so that the n v 's are conserved. Then one can introduce 
finite particle Markov chains C nij ... i1lv . Suppose in addition that, for any couple 
of types (v, w), 

a vw (T, T') = a vw (T + T') , 
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which means that the rates depend only on the sum of energies. 
We need the following definition. Fix a pair (v,w) of types and let ,£ w be inde- 
pendent random variables with joint density p v {x)p w (y). Denote 

P P v Pw = Ppv Pw (x, y\T) = P(£ v =x,£ w = y\£ v +£ w =T) 

the corresponding conditional distributions, which will be called canonical kernels 
corresponding to the density array (pi, . . . , pv)- 

Let £ Vi i, i = 1, . . . , n v , stand for the energy of the i-th particle of type v. 

Theorem 4.1 Fix an array pi,. . . ,py and let a system of v ^ v + 1 ) reactions with 
canonical kernels P PvPm be given. Then, for any m, . . . , ny, the invariant measures 
of £-m,...,n v are suc h that the random variables £ Vt i have independent distributions 
equal to p v . In the thermodynamic limit, for any initial concentrations of types 
(ci,...,Cv) (here the concentrations of types do not change at all), the invariant 
energy distribution is unique and given by the independent densities p v . Moreover, 
for any initial energy distribution, there is convergence to this invariant measure. 
Also, for any array (pi,...,pv) with arbitrary rates a vw (U), there is only one 
system of kernels for which this array defines an invariant (product form) distri- 
bution, these kernels being canonical kernels. 

Proof. Any transition v, v' — > v,v' conserves U and the related measures. Hence, 
as for the convergence, the argument is similar to that in the previous section. The 
other statements follow directly from the definitions. ■ 

When p v (x) = f3e^ l3x , the kernels are uniform on [0,T], as in the one type case 
study. Let P 13 denote such a kernel. An interesting situation depicted in the next 
remark arises when 

p v (x) = j3 v exp(-fi v x), 

with different /Vs. 

Remark 4.1 All other cases can be reduced to the simplest one by the following 
transformation. Given any density p > and any (3 > 0, introduce the one to one 
mapping U = U(p, (3) : R + — > R + such that, for any x e R + , 

/ p(y)dy= / fc-tody. 
Jo Jo 

Then 

P vw = {U- 1 (p v ,p),U- 1 (p w ,p))P^(U(p v ,p),U(p w ,p)). 
4.2 Unary reactions 

Now we want to tackle examples in which the n„'s are not conserved. Then, in 
general, only 

C M - II C 

TiiH \-nv —M 

is a Markov chain. In this subsection, we assume that unary reactions 

v — > w 
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can take place with rates a vw . Such reactions could be interpreted as isomer to 
isomer transformations. When I v > I w the reaction v — > w always occurs, and the 
kinetic energy T of the w-particlc becomes the kinetic energy I v — I w + T of the 
ty-particle. The reaction w — > v however occurs only if T — I v + I w > 0, in which 
case the kinetic energy T of the to-particle becomes the kinetic energy T — I v + I w 
of the w-particlc. 

Consider first the case without binary reactions. Define the following one-particle 
Markov chain: its states are all pairs (v,T), that is M = 1. Moreover, assume 
that there are only two types. Let I\ < h- Consider a pair of densities pi,p2, and 
denote by £1,^2 the corresponding random variables. We call this pair admissible 
if the conditional density of £1 — (I2 — h), on the event {£1 > I2 — Ii}, is equal to 
P2- One example is p\ — P2~ ft cx p(~ fix), another being 



Any invariant measure on {1, 2} x R + can be written as 7Ti(l, p\) + 772(2, P2) with 
positive coeeficients 71^ such that 7Ti + 7r 2 = 1. We have for 7ri,7r 2 the following 
equations 



This case exhibits the highest degree of reducibility, each class containing one or 
two elements: there are plenty of invariant measures - but this is clearly a very 
unnatural situation. For an arbitrary M with only two types, we have the product 
of M chains C 1 , which again leads to a rather unnatural situation. 
When there are V > 2 types, each class also has a finite number of elements. It is 
then possible to order the internal energies, assuming for example 



and also a vw > 0, Vv, w. If the full energy satisfies I m < U < I m+ i,m = 1, . . . , V 
(putting I m +i = 00) then there are no possible jumps to the types m + 1, . . . , V, 
so that the process evolves as a Markov chain Ci >m with state space l,...,m 
and rates a vw ,v,w — l,...,m. Hence £i jm are restrictions of C\y. For m = 1, 
it becomes a trivial one-point Markov chain. Let 7r mjt ,,u = 1, ...,m denote the 
stationary probability of the state v in £i lTO . We have 771,1 = 1- 
Note that, if at time the state is (1, U) and U has some density f(U) in [I m , I m +i], 
then the stationary distribution is defined by 7r mjt , and by the conditional density 
/ of the full energy. Thus everything is defined by the rates a vw and by f(U), that 
is p\. Moreover, these quantities can be chosen arbitrarily. Setting for the sake of 
shortness 



we propose hereafter some examples. 

Shifts In this first example we take p\ (x) = if x < Iv — h ■ Then each p v is 
just a shift of p\. 





h<h<--<Iv 



1T V = 7Tv,«, 
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Reversibility Analogously, a system (pi, . . . , py) of densities will be said admis- 
sible if the following condition holds: for any v the pair (p„, p„ + i) is admissible. 
Then it follows that each pair of densities (pi,pj),i < j, is admissible. 

Theorem 4.2 If Ii < ... < ly , all p v {x) are strictly positive and the system 
(pi, . . . , pv) is admissible then C M is reversible. 

Proof. Let f v (U) = p v (U — I v ) for U > I v and f v (U) — for U < I v . We suppose 
the invariant distribution for the chain C M has a product form, each factor being 
given by n v f v (U). This means that for each m and for I m < U < I m +i 



for j = 1, 



, m. Then admissibility means 

Aifi(U), iovU>Ii 



Ji{U) — 0, otherwise. 



Hence 



,V. 



i=l i=l 

Putting ^ = 7TjAj, it follows that 

m m 

^PiO-ij = Pj Y 1 - 3 - m > Vm = 1, . . 

i=l i=l 

The comparison of these equations for m and m + 1 yields 

Pm+ia m +l.j = Pjttj.m+l, Vj = 1, . . . ,m 
and by induction we get 

P<«.j =PjO-ji, Vi, j, 
which implies the announced reversibility of £ M . 



Exponential In this third example, we also assume the system (pi, . . .,py) of 
densities is admissible, and moreover that, for some p(T) and all u, 

Pt, = P- 



Theorem 4.3 Suppose V > 3, and i/iai ifte quantities I 2 — h and I 3 — 7 2 are 
incommensurable. Then 

p(T) = /3exp(-/?T), 

for some (3 > 0. 
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Proof. Admissibility implies that 

P2 {T) = A 2Pl {T + I 2 -I 1 ), 
P3 (T) = A 3Pl (T + I 3 -h). 

If Pi = 92 = P3 = P then 

p(T) = A 2P (T + x 2 ) = A 3 p(T + x 3 ), 

where Xi = Jj — Ji, i = 2,3 are incommensurable. But these last two equations 
are compatible only if A^ 3 = A^ 2 and p(T) = /3exp(— /3T), with 

_ logA 2 - \ogA 3 
X2 - x 3 



Energy dependence In the fourth example, the rates a vw = a vw (T) depend on 
the energy of the input particle v. To construct a model which will be needed later, 
consider a reversible Markov chain Vi on {1, . . . , V} with stationary probabilities 
p v and rates b vw . Thus 

Pvbvw — Pw^wv- 

For reactions v — > w, define the reaction rates as 

r 0, if U<I W , 



VIV 



(U) = 



(U — I w ) a ™b vw , otherwise. 



Note that these rates are close to zero if the kinetic energy T w = U — I w of the 
w-particle is close to zero. Letting f v (U) be the density of the full energy of the 
w-particle, the reversibility condition writes 

x v fv(U)a vw (U) = n w f w (U)a wv (U), (4.1) 

for U > m&x(I v ,I w ). We take as density / the shifted T-distribution 

uu) J^-'-r-^i-w-v},«u>i„ (42) 

[O, otherwise. 
Here v v =0^ + 1. Then equation (|4.1[) becomes 

' !T vP Uv /3i vh _ ^wP Vw ri w , 

T{V V ) T{V-m) 

showing that the stationary probabilities tt v of type v are equal to (up to a common 
factor) 

p v e-^T(v v )(3-^, (4.3) 
and the resulting Markov chain is reversible. 
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4.3 Binary reactions without energy dependence 

Let us suppose that a vw do not depend on energies, so that types evolve indepen- 
dently of the energies. Thus at any time t, we will have probabilities Pt(ni, ■ ■ ■ , ny). 
We will look for cases when there exists an invariant measure on each L M , defined 
by probabilities p(fii, . . . , ny), and independent conditional distribution of ener- 
gies 

j { Pv,h 

[given ni, ... , ny], defined by densities p v .i(x) = p v {x). 

Assume all I v y s are equal, but any reaction v, w — > v' , w' can occur and let now a 
reaction v,w — > v' ,w' be given. We again call 

P Pv , Pw ,(x,y\T) 

the canonical kernel corresponding to the reaction u, u; — > v' , w' and we denote by 

Pvw 

(T) the density of £„ + £ w . 

Theorem 4.4 Suppose an array (p%, . . . , pv) of densities is given, satisfying for 
any binary reaction v, W — t v',w' the conditions 

Pvw{T) = p v (x)p w (y)dxdy = p v ,{x)p w ,(y)dxdy = p v > w .{T). 

Jx+y=T Jx+y=T 

Assume also canonical kernels and that, as t — > oo, the limit of Pt{n\, . . . ,ny) 
exists. Then there is an invariant measure having these densities. 



4.4 General binary reaction case 

Here the I^'s can be different, but we assume only binary reactions v,w — ¥ v',w' 
are possible. 



4.4.1 Complete factorization 

Denote i a pair of types (v, w). Thus reaction v, w — > v' , w' will be written as i — > j, 
where i — (v,w),j = (v',w'). We shall use the analog of the third example with 
binary reactions. Consider a Markov chain Vi X Vi on {1, . . . , V} x {1, . . . , V} with 
rates 6jj, such that its stationary distribution be a product form p< v ,w) — PvPw 
and the chain be reversible. We define, for vector particles i = (v,w), the energies 
h = I v + I w and 

MU) = (f v *f w )(U), 

where f v , f w are given in (I4.2[) . Thus fi(U) has also a shifted T-distribution with 
parameters — I v + I w , v% = v v + v w , (3. The reversibility condition, with some 
unspecified stationary probabilities 7rj, writes 

n t fc(U)a t} (U) = 7r 3 f s (U)a 3t (U), (4.4) 

where U > max(Jj,7j). Letting 



arAU) 



0, if U < I s ; 

k (U — Ij) as bij otherwise. 
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Here 



a s = v 3 -\ 



V'i 



and the reversibility condition becomes 

We are looking for solutions tt( VjW -) = t^v^w, since we are primarily interested in 
factorizable invariant distributions. To this end, we assume in addition that, for 
any binary reaction v,w — > v',w', the condition 

Vv + v w = V v i + V u ,f 

is fulfilled. Then 

and up to a common factor, the solution of this system has the form 

n v =p v e-^0-^ (4.5) 



4.4.2 Unary reactions included 

Let V = [J a V a be a disjoint union of sets V a of isomers. Thus, we assume that 
unary reactions v — > w are allowed only if v and w belong to the same V a . The 
energy dependence of unary reactions will be defined in the same way as in section 
14.21 but additionally we take v v to be constant on each V a , in other words v v = v w 
for any two isomers v,w € V a . 

We consider the same binary reactions as in section I4.4.1[ with the assumption 
that they are concordant with unary reactions in the following sense: P( v ,w) = PvPw 
are such that, for any a, the probabilities p v have the form given in section f4. 2 1 up 
to a constant factor. 

Theorem 4.5 If the previous conditions are fulfilled, then formula {4-5ty gives the 
factorized reversible invariant distribution, both for binary and unary reactions. 

Proof. It suffices to compare the formulae (j4.5[) and (|4.3I) . remarking that the 
factor T{y v ) in (|4.3[) can be omitted, since v v is constant on V a . ■ 



References 

[1] E. Carlen, M. Carvalho and M. LOSS, Determination of the spectral gap 
for Kac's master equation and related stochastic evolutions (2001), Preprint. 

[2] M. Ernst, In Nonequilibrium Phenomena I. The Boltzmann Equation, North 
Holland, 1983. 

[3] M. Kac, Probability and Related Topics in Physical Sciences, Interscience Pub- 
lishers, 1958. 

[4] A. Kalinkin Markov branching processes with interaction, Russian Math. Re- 
views, vol. 57, No. 2 (2002), pp. 23-84. 



14 



[5] M. A. Leontovich, Main equations of kinetical theory of gases from the 
random processes point of view, J. of Experim. and Theor. Physics, vol. 5, 
No. 3-4 (1935), pp. 211-231. 

[6] V. Malyshev, S. PlROGOV and A. Rybko, Random walks and chemical 
networks, to appear in Moscow Math. J. 

[7] D. McQuarrie, Stochastic approach to chemical kinetics, J. Appl. Prob., 4 
(1967), pp. 413-478. 

[8] P. Whittle, Systems in Stochastic Equilibrium, John Wiley. 1986. 
Guy Fayolle 

INRIA Rocquencourt - Domaine de Voluceau BP 105 
78153 Le Chesnay, France. Guy.Fayolle@inria.fr 

Vadim Malyshev 

INRIA Rocquencourt - Domaine de Voluceau BP 105 
78153 Le Chesnay, France. Vadim.Malyshev@inria.fr 

Serguei Pirogov 

IPPI - Russian Academy of Sciences 

19 Bolshoi Karetny - 101447 Moscow, Russia. 

Work partially supported by RFBR grant 02-01-01276. 



15 



